Comparisons against baseline within randomised groups are often used and can be highly misleading

BACKGROUND In randomised trials, rather than comparing randomised groups directly some researchers carry out a significance test comparing a baseline with a final measurement separately in each group. METHODS We give several examples where this has been done. We use simulation to demonstrate that the procedure is invalid and also show this algebraically. RESULTS This approach is biased and invalid, producing conclusions which are, potentially, highly misleading. The actual alpha level of this procedure can be as high as 0.50 for two groups and 0.75 for three. CONCLUSIONS Randomised groups should be compared directly by two-sample methods and separate tests against baseline are highly misleading.